OOCiaiMl IBSOM 



10 179 195 

TZT1£ 

IMSXIIUZIOH 



SPOMS AGENCY 

PUB oa;£ 

GRAliT 
.M07£ 

BOSS PfilCS 
tlESCBIPTOBS 



lOEMTIFIEBS 



ABSXfiACI 



21 007 B56 

Indlvidu allied. Inttruction for Data Acc€Sf (IIOA) . 
Quarterly Fepcrt Mo^ 4. 

Orexel oniv., Philadelphia, Pa. Graduate School of 
library Science*: Prasklin ln«t« fieeearch Labs.. 
Philadelphia, Pa. 

National Science Foundation, Nashingtcn, D.C. 
Mar 79 

DSl*77-2652a 

3 3 p.; For related docuaent, see ED 168 46 2 
MF01/PC.02..P1US Postage. 

*C0Bputer Assisted Instruction; *Ccipiiter Prograas; 
Data Bases: Higher Education: >«lndivi dualised 
Instruction: ♦Inforsation Retrieval; Infotaation 
Systeas; On Line Systems : ^Search strategies; Systess 
Analysis 

♦Coaputer Software: DIALOG; *Individuali2ed 
Instruction fcr Data Access 



^ A brief susiary of the progress and status of the 
Individuaiixed Instruction for Data Access IIIDA) project is followed 
by a report focusing on the principles and rules for analysing a 
coaputer search performed using the I IDA software, and adaptation 
rules for the defer sent of error aessages in the case of frequent 
violations of the saae rule. The IIDA coaputer software systea 
consists of four aaln programs, three in the exercise aode— 
prelialnary introduction to searching, a practice search exercise, 
and sore advanced training, and one in the assistance aods designed 
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SuwMiry ot Protftt tod 8f tut 



Vitw«d at a eonputar aoftvara tyttaai IXDA conaitta of four main prograoas 



( 



« 

\ 

1* Ex«rcittt 1: A preliiainary introduction to sMrching. 

2* Exttreit* 2: A practice SMrch «xercia«,t>uting only th« basic search 

coonands. Tha search is assigned the system. 
3* Exercise 3: More advanced training. 

Assistance Mode 

4. The assistance node program: The user perforas a search of his own 

choosing) using almost any DIALOG command. The function of IIDA in 

this mode is to provide assistance in the performance of the search. 

Those commands excluded are PRINT and those associated with Selective 

^ ai 

Dissemination of Information (SDDy none of which lend themselves to 
having results iomediately evaluated. 



At the present time^ all programs are operational. The evaluation plans 
detailed in IIDA Quarterly Report Number 3 (1) will evaluate program 4 (IIDA 
as an assistant) and program 1*3 as a whole (IIDA as a teacher). 

The program logic description in IIDA Quarterly Report Number 1 (3) is 
partially obsolete and will be replaced in a subsequent report with an 
up-to'-date account. IIDA Quarterly Report Number 3 (1) deals with evaluation 
plans. Current plans for subsequent reports are: 

'4 



QR No. 5, JuM 1979t Th« llbk t««ehliit progrpat 

QK Mo. 6, S«pe. 1979t IZOA eo«put«^ ptO|r«w, r«vlf«d docuatntatioii 

QR Mo. 7, 0«c. 19791 Prtllalnary ov^liMtioa rttulet 

Juao 1980: Fin*! Ropore 
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Oehor roeont publlcationti rttulting from eho IZDA projoce tret 

Ftnichol, Carol R«nt«n, Onlino Inforawtion RotrUvlt Idontification of 
Mtatw that Diicrlainaf Aaopg Uaori with Difforont Uvia and Tvpot of 
Exporitnco. Ph.O diaaartation. School of Library and Inforaatlon Scianca, 
Oraxal Univaraity, Philadalphia, 1979. y 

Maadow, Char lea T., "Tha Computer aa a Search Intermediary," ONLINE, July 
1979 , 54- 59. 

** 

The achedula for completing the project ia, in condenaed forml 

Begin in-claaaroom evaluation at Drexel June 19, 1979 

Begin Engineering Technical Writing evaluation June 19 

Begin Library Science evaluation Aug. 6 

Begin Induatrial Laboratory evaluation Oct. 1 

Complete any needed reviaion of computer progrima Sept. 15, 1979 



2. im Di«tno«tic« 

. ' i 

2*1 Oi«tno«tic Principltt 

In thit t««tioa r«vi«w thft naturt of th« dtagnottle «tutlyt«« w£ a * 
••arch ptrform«d by IIDA. .Individual procadarat aay vary, aa a raault of 
axpariaantal triala, but wa axpact that tha baaic araaa of analyaia will 
raaain constant throughout tha ranaindar of IIDA davalopmant; Tha major araaa 
ara littad balow and tha spacific diagnoatic rulaa ara givan in tha.naxt 
aaction* 

In studias of othar intalligant taaching systaot (4,5) ve find tha ganaral 
pattam that tha program '*kno««" tha subjact matarial vary vail, or parfactly. 
This iteana that tha program knowa axactly what ia wrong if tha objactlva of 
tha atudant ia to diagnoaa a fault, or knows axactly how a problam should ba 
attackad and tha kinds of arrors studants ara likaly to maka if tha objact is 
to analysa axacution of an algorithm, a.g., addition. Such a modal of tha 
saarch procasa continuas to aluda ua. Wa cannot stora within tha computer a 
modal of axactly how a saarch should ba parformad and than compare tha 
student's performance with it. We are designing both the model and tha 
comparator siaultaneously. Unfortunately, wa need the results made available 
by the comparator in order to refine the model. The entirety must be viewed 
aa an iterative process, not to be considered complete at tha conclusion of 
the IIDA project. 
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It it th« principal obj«etivt of IIDA dlafnettie proetdurtt to owkt th« 
uMr «iftr« that probltw txltt and to tuggett that ha giva eonaeioua thought 
to tha atruetura of tha aaareb aa a whola^^ to tha fact that a aaareh la a 

» 

•tructura to^ba daalgnad and, If tha daaign provaa flawad, to ba radaalgnad. 
What la la^ortant la that wa hava thla laval of coawuilcatlon. with tha uaar, 
not that va ba abla to da tact axaetly tha trua natura of his "arror." Aa la 

» 

of tan said about contandlng partlaa In huaan affairs, tha Important thing Is 
to atart tha dialogua, not nacaaaarlly to ba cartaln that tha praclaa flaw or 
aourca of conflict haa baan dUcovarad, 

2'«I.1« String and Cycla Analysis * A string Is a saquanca of cottoanda of 
tha Sana claaa. For alapllclty, QOMBINE conaands ara a claaa, as ara TYPE 
conman^a. For a cooplata braakdown of DIALOG connands, by claaa as. vlawrpd In 
IIDA, aaa labia 1. Slnca IIDA waa daalgnad bafora Lockhaad announcad - SUPER 
SELECT, that capability Is not taught or handlad by IIDA. Convantlonally (6) 
saarchlng Is dona by prograaalon from tha salact-^xpand class of connands, to 
conblnaa, ta typaa, to prlnta. Alao convantlonally, saarchars go back and 
rapaat this saquanca, or a portion of It, savaral tlnas during a saarch. A 
cycla Is ona prograaalon fron tha sa lac t-axpand class of comnands to tha print 
cooaanda* A cycla ands whanavar a saarchar goas bapk to a previous class In 
Chit Mqutncta It is not a«cts«ary that a cycla have an inatanca of each 
claaa of coaBatida The first level of IIDA diagnosis is to examine the length 
of strings and cycles. 

Neither of .these aeaaures (string and cycle length) is 9 in itself ^ proof 
of failure or even lack of success in a search a On the other hand^ an 



typA^ttin Coowmd CooBMts 



0 BEGIN 

1 .JILB 

2 END 

3 END/8AVB , 
' 4 SND/SDI 

' 5 LOGOFf 

8 LIMZTALL 

0 EXPAND ylildi « lipcnE froil «lph« lnd«x 

1 EXPAND yialdfl a stgMtit froa thtttaurus 

3 SELECT singltt dMcrlptor only 

4 SELECT singl« dttterlptor for E-kAbl« 
8 PAGE used in eonttxe of EXPAND 

0 COMBINE «11 optratort art "AND^* 

1 COMBINE all oparacort ara "OR" 

2 COMBINE mixad '.!AND" and "OR" oparatora 

3 COMBINE (saaa as abova - distinction to 

ba dataralntd) ' 

4 SELECT nultiplt daseriptors froa E'table 

5 UMH 

6 SELECT contains an Infix 

7 SELECT ttra is truncatad 

0 TYPE^ with sat arguaant 

1 DISPLAY with sat arguaant ^ 

2 TYPE with accassion #.. arguaant 

3 DISPLAY with accassion # arguaant ^ 

8 PAGE usad in eontaxt of TYPE/DISPLAY 

0 PRINT 

1 PRINT contains sort fialds 

2 PR'- cancal print cosnand 

0 EXPLAIN 

1 DISPLAY. SETS 

0 .RECALL 

1 .EXECUTE 

2 .RELEASE 



Table 1. Cooaand Classification in IIDA 



«r« b«lng crMtftd but ntv«r ut«d in ltt«r coAandt,^ th« astuttption la that 

« \ ■■ ■ ■ 

thay, ara parhapa 111-eonaldarad. Thia may ba an indication of thraahing (Sae 

2.^.5) I tha rapid changa of diraetion of aaarehing. IIDA counta tha nuabar of 

iinuaad tats craatad in aach ^cla, but conmanta to tha uaar only ^•n, aftar a 

cycla, tha tunbar of unuaad aata ia graatar than it waa at tha and of tha 

^ » 

pravious eye la, indie;iting a poaaibla trand toward craating an incraaaing 
nuabar of sats navar uaad. Null aata ara not ehargad to. tha unuaad aat 
eount. Thia is conaidarad to ba a oodarataly sarioua problam.' 

2.1.5. Thraahing . Thia ia tha fault of changing "diraetion" of a aaarch 
rapidly or of tan, without pursuing any givan diraetion far anough to saa if it 
<an work out. Guasaing at poasibla saarchar motivation, it might eoma from 
ovarly aasy diaeouragaaant with praliainary raaults, such aa getting a null 
sat or an axtramaly large ona from ona aaarch formulation, and ,not trying to 
modify that formulation, but inataad turning to a completely different 
approach. At its worst, thrashing is indicative of random, uncontrolled 
behavior. We cannot, of course, aeaaure "direcUon" precisely. We do it in 
somewhat arbitrary fas'hion by taking a mesaure of the similarity of the 
boolean expressions in successive COMBINE comAwnds. One consequence of this 
ia that thrashing can occur' only within a string of COMBINES. The measure, 
calltd the •imllArity ind<x > U xuim up from the percentage of iapUed terms 
In conaon to the two expreseionsa By "implied** we meen thet en expression is 
expended^ by replacing set numbers with their defining terms ^ end then the 
similarity count is done on terms^ not set nuiabersa We compute the number of 
terms in common^ divide that first by the number of terms in one expression^ 



eh«n by eh« nuoi^M in th« oth«r, and tAk* th* m««a. This giv«s chft siaiUrity 
iad«x b«t«ft«a any two COMBINE eoMunds* 

Thrashing ia a mildly aarioua problam. A little bit of it doaa no 
particular harm* A great daal of it indicataa a aaarchar ia in troubl«y but 
would 4lao notica an fxcaaaiva string length, and possibly other faults as 
welle Bance^ dttaction of thrashing is priiurily o£ b^efit in pin-pointing 
the nature of the cause of the excessive number of COMBINES 

' 2. 1.6. Dwelling * This is behavior opposite to thrashing. It is remain* 
ing with a search concept when it may be time to give up and try another 
approach. Again, we recognize dwelling onlyv within a string of COMBINES. The 
similarity index is used to recognise dwelling, but this time it is in cases 
of similar COMBINE expressions, rather than dissimilar, that an IIBA message 
is sent to the user. Also used is the concept of convergence or divergence. 
The searcher will have been asked at the beginning of an IIDA-mediated search 
to state his search goal, as a numeric step function. If a string of similar 
CCMBINEs shows progress toward that goal, we are less concerned about 
dwelling; if he is progressing away from the goal but remaining with the same 
basic search concepts as indicated by the similarity index, he is dwelling. 
Regardless of convergence or divergence, if a similar string is too long, he 
is dwelling. Dwelling can be a serious fault in that it might be indicative 
of a lack of understanding on the part of the searcher as to what a mechanical 
search, performed by someone of his skill level, is capable of producing. 
Perhaps the best example is a case in which the data base simply does not have 
much information on the sought-for subject. Excessive dwelling does not help 
much; the problem is to realize the meagemess of the lode. 
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2.1.7. RjUvMc*. Much ha« btm -wtitttn about th« o«tur« of r«l«v«nc«, 

« 

•11 of which m- mtly tidt-tttp In IIDA. R«l«v«nc« la « judgatnt midt^by « . 
•tmrehtr about tha valua of aaarch raaulta to him. Wa cannot control how ha 
thinHa about tha conoapt and wa do not go into what might ba boring and , 
divarsionary taaching on tha^aubjaet. IIDA doaa aak tha aaarchar to maka a 
ralavanca judgmant aftar aach printing of a racord (uaing tha coenand ItPE or 
DISPLAY), uttlaaa tha diaplay waa dona uaing format 1 ^ich fhowa only 
accaaaion nuirf)ar., Tha judgmant ia baaad on a acala of 5, from irralavant to 
highly ralavant. Diagnoatica ara parfomad on tha avaraga ralav wca figuraa 
for a group of racorda displayad with a aingla command, aa long aa at laaat 
thraa racorda ara typad. Ralavanca diagnoatica ara not baaad upon laulta, or 
saarch arrora, but thay ara utad to diract tha attantion of a »aarchar to tha 
fact that a particular aat aaama not to ba fruitful, or that a pravioualy 
axaminad sat yialdad highar ralavanca acoraa. Although low avaraga ralavanca 
figuraa giva no hint at to cha ramady, tha problam datactad ia a aarioua 
ona ^ tha aaarchar haa coma to tha and of a cycla and ia diaaatiafiad with . 
tha raault;i according to hia own definition of ralavanca. If thia condition 
racura rapaatadly at tha and of cyclaa, tha antira approach to tha saarch 
comas into question. 

2,1.8. Print control . There are two aspects of print control errors. 
The first is use of a format that ia likely to be uniuformativa. Tha extreme 
caaa here is a DIALOG format which gives accaaaion numbera only and ia of no 
help to a aaarchar for browaing purposes. The other is excessive printing, 
typically by typing out too many records in a longer format. While some 



long«r-£orwit typing U ntcts»«ry, u^*r» miBt b« ?«u^t to bt c«r«£ul of th« 
uM o£ thi« r«»ourc«. In th« ct»« o£ ftltction o£ « £or««t, foraat 6 (titl« 
and «cc«ition nuibtr only) ii not too in£om«tiv«, but !• £rtqu«ntly u««d, «t - 
U««t to vakt «a initial judg««tnt about th« gtn«r«l reiov«nc« of « Mt. We • 
«ttuM that novice t^erchert would, «t l«««t .«!0«etlBti/ ui« more information 
for dec i» ion meking. Except for the uie of format I, the problem is not 
critical to the »ucces« of a •earch. It can be lerioui to the coat. Of 
course, if a aearcher never uses a format other than 6, and also shows in- 
ability to find new descriptors when his first choices fail to work out well, 
then this would be a serious problem. Foti this reason, IIDA will take the 
initiative in searching previ^jisly viewed records for new terms if the 
searcher does txot do it hixaself , through a facility called descriptor 
assistance (da). Invoked by the user, da provides a fast w^y for a/searcher 
to examine descriptors in retrieved records without use the TWB coamand. 

2.1.9. Use of null sets . Thir class of faults is concerned with cases in 
which a searcher uses a set which is null in, a COMBINE, LIMIT or TYPE comand. 
In the latter two cases, the result will fie again a' null set or no typing at 
all. In case of a COMBIKE , the result depends on the logic used. Since it 
has been our observation that novice searchers are often guilty of not reading 
system messages, including those labeling a set as null, repetition of this 
fault indicates that the user is not basing his search expressions on results, 
but on how he hoped the search might work out. (Not nov planned, but con- 
ceivable, is a diagnostic to see if positive steps are taken to reduced sets 
of unusually large sise, by UMITINC, for example.) Repeated use of null sets 



it M ••riout problta. Notts Th« dttaetioa of null tte uttgt it « function of 
tht XZDA ptrttr, rtthtr thtn « ditfaettie program* 

2*1 •10. Tit « Tht tiat bttvttn « atchiat't attttgt an^ tht input of tht 
ntxt cooBtnd hy tht uttr .it mttturtd. Exctttivt contua^tion of tint it, of ' 
eourtt, txptntivt and it alto an indication of tttrchtr difficulty. \ In ad* 
4ition to ptdagogical valut, tht tint ataturttatnt ctn bt uttd to ^ndnatt 
a uc<*r'« ttttion if tht dtlty it txtrt&it, indicating that tht ptrton hat 
probably Itft tht ttrminal but not loggtd off. Tiat it not critictl to tftarch 
logic, but long dtltyt inhibit tht txttnt to ^ich t ptrton can rtatnbtr all 
ht hat dont prtviw«.«ly and, in tarly txptriatntal work hat bttn found t good 
ditcriainttoj^'bttwttn txptritnctd and intxptritnctd tetrchtrt (7). 

2.U11. Syntax . SynUx trrort art cauttd by. a lack of knowl^t of tht 
langutgt, typing trrort, and toaetintt confution. IXDA can do littlt about 
typing trrort, but it it ttttntial to catch tyntactic trrort, tithtr in IIDA 
or DIALOG. IIDA givtt aort inforaation to tht arrant uttr about rtcoytry; 
tttnct wt ttttapt to catch all trrort that DIALOG would itttlf cttch. Tht 
rtatdy IIDA offtra for trrort, onct dtttcttd, is to providt inforaation about 
pr9ptr fora of coouMndt if tht uttr rtquttts it. Ht frtqutntly stt btginncsrr 

If 

bting coafuttd about cooBaod foraatt, particularly confuting ont conaand with 
aoothtr, or ont ttarch languagt with anothar. Whilt a traiatd huaan obttrvtr 
ctn rttdily tte this pattern, and whilt we can prograa a coaputtr to tee it, 
thit degree of ana ly ait of the nature of errors we have deeaed too expensive. 
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H«ne«, iM restrict ourt«lv«« to dtttetlnf th« f«ct of «n •rror, to stating 
to th« ttudant th« «t«usptioa «• h«v« aadt about a coMaad, part of which it 
la trror, and hopa that ha will tafca tha initiativa in raaolving any raaaininf 
problaat. Suppoaa tha uaar hat craatad a sat 7 with 9 racorda. Latar in tha 
•aaa saareh ha antara tha comandt TYPE 7/6/10-18. IIDA will idantify this 
arror and call it to tha uaar't attantion with: 

****SYNTAX ERROR: coanand aaauaad: 'TYPE*? arguaant assumad: * 7/6/ 10-18* 
Tha arguaant ia accaptabla up through *7/6/'. Howavar, tha firat racord 
nuabar ia graatar than tha total ounbar of racordt in tha sat. 

Syntax errors ara critical in inportanca from the point of viaw of 
catching than, but, sinca all ara caught, aithar by IIDA or DIALOG, thair 
iaportanca to tha outcoaa of tha search is ainor. 

2.1.12. Slack and help requests . This is a specialized problem for 
monitoring. IIDA will have self-aodifying thresholds for some diagnostic 
variables (See Sect. 3), with the general rule that they will become more 
stringent as a particular error with which a variable is associated is 
repeated. A user may requeat that this tightening of control- by IIDA be 
eaaed* aaking for a alackening of control. Ideally, he should request this 
when he haa realized what the problem is and has taken remedial action. But, 
to* avoid abuse, we will monitor the use of this slack option. We cannot, at 
this time, predict the <ieriousness of the problem. 

IIDA will also monitor the use of help by the searcher. In the case of 
both help and slack, their uae is not directly a search logic problem but may 
indicate a uaar who is confused or not using this system seriously. 



2.2 Oi«(aottic RuUt 

Th« dUgnottic rultt h«v« phangtt only slightly ixom tht vtrtlon dtttcrib«d 
In IBA Quarterly Ktport No. 2 (2), but thty art r«vlaw«d hara in thalr 
antiraty. 

2*2 •! Ginatal configuration * In it a priaant configuration IIDA uaaa 
diagnoatic rulaa to datact procedural arrora othar than ayntactic arrora. In 
addition, ita paraing program datacta ayntactic arrora in DIALOG or IIDA 
comanda aa wall aa caruin uaaga arrora auch aa uaing a null aat in a COMBINE 
or TYPE cooaand. 

Wa praaant, firat, a daciaion traa which ia the logical aquivalant to tha 
diagnoatic procaduraa, hut doaa not repraaant tha daaign of tha algorithaa. ■■. 
In thia traa, thoim in Figura 2.1, claaaaa of arrora, rather than apacific, 
detailed rulea, are illuatratad. The warning control program (WCP) <2) ia 
invoked often to make the final daciaion on what aaaaaga goea to tha uaar, 
following one or more detected errors. 

Figura 2.1 ia an abatract of the fixll tree. It ahows checks for (1) user 
reaponaa time, (2) syntax arrora (detection of ayntax error in a DIALOG or 
IIDA conaand cauaea rejection of the command, hence there is no further 
diagnosis), (3) repeated comaands, and (4) excessive string length. If a 
cycle has juat ended (5) a check is made for (6) unused sets and (7) low 
average relevance. If not at tha end of a cycle, teats are made for (8) null 
sets generated, (9) LIMIT/CCXIBINE conmand errors (e.g», dwelling or thrashing), 
(10) TYPE/DISPLAY errors (exceasive printing or relevance problema). 
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rifur* 2.2 thoiM th« 4i«tnottict in gr««t«r detail. In pirt a, .if ut«r 
rtspont* eiM (1) it •se«ttiv«, thtn « check it Mdt (2). to t«« if tht utet 
hat b««a pr«vioutly wamtd. If to (3), hit tattion it taraiaatad. If not (4) 
ha it wamad that to«a ratponta it nacattary to avoid tarmination. If tiat it 
not axcattiva, than whara a ratponta it racaivad, it it firtt chackad for 
tyntax validity <5). 

An invalid coMand it rajactad (6) with at pracita identification of tha 
nature of the error at pot tibia. . If the comnd it a DIia.06 coaiand (7) than 
it it checked for repetition (exact or attential, e.g., C 1 * 2 it ettentially 
a repetition of C2 * 1) (8). If there it a repetition, tha WCP it informed 
(9) and in aithar cate tie next check for ttring length (10). If ttring length 
it excettive, the WCP is informed (11). In either cata, «a awva to 2 in part b. 

Return, now, to the "DIALOG cotnand" dec it ion (7). At the pre tent ttage 
of devalopMent three dattat of IIDA coaaand are racogniaedt HELP, SLACK and 
DBSCRIFTOR ASSISTANCE. If the cbonand it HELP (15) it it executed (16). If 
not HELP, than DA it tatted for (16). If it it DA, that prograa it executed 
(17) and a new cooaand accepted. If, the comand it SLACK, it it tatted for 
repetition (18). If repeated (19), the utar it inforaad. If not repeated 
(20), it it executed and, in either cate, another conaand it tought. If the 
coMand U DA (descriptor attistince) it is executed and, at tha end, another 
coaaand is sought. 

In pfcA-t b of the tree, a test is aada for tha and of cycle condition (21). 
If present (i.e. an earlier class of conaand is used) a test is aada for an 
excessive nuaber of unused sets having bean generated during that cycle (22). 
If the test is positive, WCP is Inforaed (23) and tha program proceeds to 
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ch«ek for lew z«l«vine« of rttritvtd rteotdt (24). Ag«ia, If found, WCP i« 
iafomd. Th« next fat f« for « null Mt g«a«rAt«d (26). If th« Ust 
eoMiaiid did g«a«ract a oull stt and it vat a SSUCT eoanand, than tha program 
looks up tha wars in an IIOA-nuiintainad tabla which tails whathar that tarm 
was avar saan in an BXPAND display (28). Tha WCP is than infomad (29). If 
tha coMsnd uara not a SELECT » than it was a LIMIT/CQMBIME (nothing alsa 
ganaratas sats) and WCP is so informad (30). If a null sat wara not ganar> 
atad, than a tast is nada to saa if tha conund wara of tha COMBINE/UMIT 
class (31) dnd, if so, whathar a null sat was usad in its arguaant (32). If 
so, tha usar is inforoed (by tha parsar) (33), and wa continua ehacking for 
CQMBINB/UMIT faults in part c, at 3. 

In part e, dwalling is chackad for (34) and thrashing (36). If aithar is 
found, tha WCP is infomad. In any casa, tha and of tha diagnostic traa is 
. raachad. 

Part d concams tasts on TYPE/DISPLAY consands (38). If tha conund is 
not of that class, tha traa is tarmnatad. It it is TYPE/DISPLAY, a chack is 
oada (39) for null sats usad and than (40) for ajccassiva printing. Following 
this, ralavanca is chackad. If svaraga ralavanca for tha stibsat of racords 
printad irith tnis coomand <«2, a diagnostic massaga will ba sant. If chara 
had baan a pravious sat that had ralavanca >«4, ona massaga is sant (43). 
If not, a diffarant nassaga is sant' (44). If tha most racant subsat had an 
avaraga ralavanca >«4 (45), a nassaga is sant (46) suggastiog that tha 
saarch may ba complatad. In all caaas, tha traa is tarminatad. 



2*2.2. Proctdural dlatnottie nilti . Tht tuUt thoim in Tablt 2 «r« for 
4i«t»e«lt of proetdurt only. Tuta tot ayntac^ie validity and Cha uaa of null 
aata ara sada by tha ZIOA eowand faraar progras (2). Additional dataila will 
b« forthtfoaing in a futura raportr . < 

. .V 

Tha rulaa ara groupad into 9 eatagoriaat 

/ 

1. String langth 

2. Coaaaod rapatition 

3. Hull aat ganaration 
4.. Unuaad aata 

5. Thraahing 

6. Dwalling 

7. Kaeord ralavanea 

8. Print control 

9. Uaar raaponaa intarval 

Tha rulaa ara liatad in Tabla 2 and ara mvobarad according to taaaai cata- 
goriaa, and than aaquantially within catagory. Nuabera in paranthaaas rafar 
to a aaquantial liating of rulaa aa actually atorad within tha covputar. Each 
rula conaista of a natural languaga atataaant of tha ,rula followad by tha PL/I 
prograsMing languaga itatanant of tha aaa» rula. 
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1. Striiii Itntttt 

1.1 (3) . 

if th« tl^m> eoHuuid oceurt 8 tlMi coiif«c«tiv«Xy(coiii«nw.typ«) 

1.2 (4) - 

if th« SlUECT eoaumd oeeurt 8 tiaat coat«ctttivtly(eoiit.ao«r.typ«) 
then « Mtfagt it tignAlltd (t«.ftnd(4)). * 

1.3 (5)' 

if tyi^ 2 cownda (EXPAND/ 8SLICT) oeeur 8 eiMs eontaeutivaly 
<con»«tioir.typ«) than « if fifaalltd (tt«««iw«5)). 

1.4 (6) 

if th« 00MB INK coaund oecurf 5 timtf eoai«cutivaIy 
(stritig.l«igtfa(f.last,ft.lMt)) than « attfac* i« ■isn«ll«d 

(tii^Miid(6)). 

1.5 (7) 

if th« TYFB coound occurs 5 timt eonftcutivtljr 
(t:rins.l«ngth(f.latt,ft.lMt)) thm « Mtf«g« is fign«ll«d 

(t««Miid(7)). " 

1.6, (8) 

if any atring of conanda ia XO (atring^langth(a.laat,at^laat)) 
and tha aajor coaaand typa (c typa.aaj(c«l,aat)X ia > 4 than a 
•aaaaga ia aignallad (ta.aand(8)). 

1.7 (39) ' • 

if tha langth o>f any string of ' connanda aquala 20 
(atriag.langth(a.laat»at.laat)) than a naaaaga ia aignallad 
(ta.sand(39)) and tha uaar is losaad off. 

2. Conaand tapatition > 

6 . • » 

2.1 (2) 

if tha nuabar of aaaantial rapatitiona thua far in tha aaareh 
(rapjcat^aaarch(2)) ia 1 or laaa and^at laaat ona auch rapatition 
occura during tha currant cycla(rap.kntucyela(2)) than a naaaaga 
ii signalla^ i[ta.a«nd(2)) which ^givaa tha rapaating coonanda and 
halp ia offarad. 

2.4 (22) ■ ' 

if tha nuabar 6f axact rapatitiona thua far(rap.knt.aaarch(l)) ia 
1 or aora and at laaat ona auch rapatition. occura during thia cycla 
than a aassaga ia aignallad (ta.aand(22)). . 

\ 

T*bla 2. Procadural Diagnoatie Rulaa, Part a. Coluan 1 fa tha rula nuabar 
claaaifiad by purpoaaa; Coluan 2 ia tha nu^ar in ordar of coaputar 
iaplaaantation, only for prograanara purpoaaa. 



2.5 (23) 

if thtt total 'eoMMnd r«p«titiont thus far (r«p. total) it 6 or «or« 
than a Msaafa ^it •Itnallad (t«.taad(23)). 

2.7 (38) J * 

if tha niabar of dual rap«ti«float(axaet and ••••ntial tianiltantoutly) 
, thut far it graatar than 1 (rap.knt«iaareh(3)) and at laatt ona 
iueh rapatition oceurt durinf^thia cycla (rap,knt,cycl#(3)) than a 
■aatasa ia tignallad (ta.aand(38)) which givaa tha rapaating 
copaanda and halp it offarad. 

• . • • 

2.8 (40) 

if tha nuabar of conaacutiva covand rapatitiona(con«rap.knT) is 
10 th«n a aaaaaga ia tignallad (ta.tand(40)) and tha utar it lottad 

off. 



3. Null tat ganaration 

3.1 (5) 

if tvo conaacutiva nulla occur from tha uta of tha SSLSCf 
eoMMn(saro.knt.cont(l)) than a mettaga it tignallad 
(ta.tand(^))«. BULB rUMCTZOHS CULT ONCE IN EACH CYCLE 

3.2 (10) 

if tvo contacutiva< nulls occur fro« tha uta of tha COMBINE 
coaBand(.aaro.knt.cbnt(2)) than a aattaga it tignallad 
(ta.tand(lO)). BUtE FUNCTIONS ONLY ONCE IN EACB CYCLE 

* 

3.3 (11) 

if tvo conaacutiva .nulls oecur(saro.knt.cont(3)) than a aattaga it 
tignallad (ta.tand(ll)). RDLE FUNCTIONS ONLY ONCE IN EACB CYCLE 

3,4(12)^ 

if thraa nulla occur in a cycla froai the uta of tha SELECT 
co«and(taro.knt.cycla(l,t«latt)) than a aattaga it tignallad - 
(ta.8and(12)), tha arguaantt givan for tha nulla, thota argumnts 
vhich. hava oecurrad .vithin tha tcopa of a praviout EXPAND tabla ara 
littad taparataly. 

i 

3.5 (13) ^ , 

if thraa nulls occur in a cycla froa tha uta of tha COMBINE 
coaaand(«aro.knt.cycla(2,t.latt)) than a aattaga is tignallad 
(ta.sand(13)) vhich givaa tha arguaantt of tha nulls. 

3.6 (140 '\ 

if thraa nulls occur in a cycla(«aro-knt.cy.cla(3,a.laat)) than a • 
aasaaga is signalled (t^a.aand(14)) vhich givaa tha arguaants of tha 
nulla. '\ , 

\ 

Tabla 2. Procedural Diagnoatic ^Rulaa, Part b. Coluan 1 ia the rule nuaber 
classified by purposes; Coluan 2 is the nuaber in order of coaputer 
iapleaentation, only for progranaers purpoaea. 



3»7 (U) V 
if tht «r|UMnt of A 8ILICT eooMnd eoattint «ort than 3 words 
, (0«et.kae) « null m ia tta^rattd (•.•is«(a.Uat)) thtt « 
< '^atAt* i« aitnAUtd (eO«ad(44))* 

3»a (45) 

if tht arfiMMQt of « SILBC7 eoHumd eoattina sort than 3 wetda 
(ap«e«.kat), thtrt art tmmt thaa 5 8IUGT «ad IXPAMD cdmadt ia 
tht tatiro aoareh <d.lMt), tad thort art Itta thaa 4 rteovda ia tha 
aat (a.aiaa(a.laat)) thaa a Maaaft ia aigaallad (ta.aaad(43)). 

3.10 (36) ' • • 

if tha arguMaat of a SBLBCT- cooaaad produeta a aull sat aad thia 
arguaant falla witbia tha bouada of a pravioua BXPANl) tabla 
(s.flag(c.laat} » "l"b) :haa a Maaaga ia aigaallad 
(t«.aaad(36)) which givaa tha arguaaat of tha pravioua EXPAMB 



4. Mtnttaad aata . 

4.1 (19) 

if tha auabar of-aoa.uaad tata craatad during tha laat eycla ia 3 
(ao.raf.eyela) thaa a naaaaga ia aigaallad (ta.aaad(19)) nhich 
givaa tha Wguaaata of tha aoa^-ubtd aata. 

5. Thraahiag o . 

3.1 (24) r 

if for a laaat 4 cgaaacutiva COMBZHS cowaada uaiag tha AMD/OR 
oparatora, tha aiodlarity iadax(aifliLavg) ia laaa thaa .25 thaa a 
ttaaaaga ia aigaallad (ta.aaad(24)) which givaa tha arguMata of tha 
COMBINB comanda. 

6a Dutlliot 



6.1 (25) 

' if for at laaat 6 coaaacutiva COMBINE coamanda uaiag tha ANB/OR 
oparatora, tha aiailarity 'iada3c(ai«.avg) ia graatar thaa .75 aad tha 
0- aat aiaa ia coavargiag toward tha goal (aat.aiaa^diap) than a. 

«aaa«|a ia aigaallad (ta.aaad(25)). 

* ' 

6.2 (31) 

if for at laaat 4 coaaacutiva COMBIHE eonanda uaiag tha Atm/OR 
oparatora tha aimilarity indax ia graatar thaa .75(ai«.avg) aad tha 
aat aiaa ia divaraiag froM tha goal(aat.aixa.diap) thaa a aaaaaga 
ia aigaallad (ta.aaad(31)). 

Tabla 2. Procadural Oiagaoatic Rulaa, Part c. Coluon 1 ii tha rula nuabar 
cfaaaifiad by purpoaaai Colutn 2 ia tha nuabar ia ordar of computar 
iaplaaaatAtioa, oaly for progranaara purpoaaa. 
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•.a (32) . * 

if for «t ItAtt 3 eoaateutlv* OOMBXIIK eOHMnd* usitis th« ATJ/OR 
operators th« •iailaritx iados it grtattr thaa ,7S(sia.ivt) aad tho 
•ot siio U auele rtUtiira to^ tha toal(ttt.siao.ditp) thta .a " 
MAsaft it •IgaaUtd (ta.ttad(32)). 

6,4 (33) 

if for tt Itatn 3 eoattcuHva OOMBZHB eoMadt utiag tht AMD/OR 
oparatora tha tiadlarity iadas it grtattr thaa .73(ti«.avg) aad tht 
tct ^tist rtlacioBthip to tht gotl etaaot bt dtttraiaad 
(ttt.tisa.diav) thta t atttagt is sigaallad (tt.ttad(33)). 

7 . : Rtcord raltvaact 

7.x (26) ; 

if tht wraragt rtltvaaet of doeusratt vitwad at thit eooMand 
(▼itir.tvt(r.latt)) it latt thta 3 (t3) sai sort thta 2 raeordt art 
tata thtn a «tttagt it tigaalltd (ta.ttad(26)). 

7.2 (27) 

if for Itatt 4 eoatteutivt TYPB eostadt tht tvtragt rtltvaaet 
(fudga.ral -> 23 > vi«ir.avg(r.latt)) it dtcrtating thtn a 
mttagt is tiynalltd (tt^ttad(27». 

7.3 (41) , . 

if for tt Itatt 4 iueetttivt TYPE eoMtadt tht svtrtgt raltvaact of 
rteordt vitwad is incrtatiag (fudgt.rtl .23 <' 
vitv.avg(r.latt)) thtn a atttagf it ticnallad (ta.fand(41)). 

7.4 (42) 

if for tt Itatt 4 sueetttiva TT?I eoaaundt tha avtrtgt rtltvat\et of 
rteordt vitwad it ttatie tad ao group hsd a raltvtaea ratiag grtattr 
thta or aqiitl to 4 (fudga.rtl.hi < 4) thta t nattagt is 
tigaalltd (tt.ttad(42)). 

7.3 (43) 

if for tt Itatt 4 sueetttiva TYPl eoMuadt tht svartgt rtltvaaet of 
rteordt vitwad it ttttie sad st Itttt oat group had a rtltvaaet rating 
grttttr thta or aqual to 4 (fudgt.rtl.ki >• 4) thta a attttgt it 
tigaalltd Ua.ttad(43)) ahieh givtt tht highly rtltvaat group. 

. 7.6 (28) 

if ataiausi rtltvaaet of a group ia tha prtviout eyelt 
(■ax.rtl(t.Utt - 1)) it grttttr thta tht atxima rtltvtnet of tht 
last e7elt(aax.rtl(t.lttt)) thtn s attttgt it tigaalltd 
(tt.tand(28)). 



Ttblt 2. Froctdurtl Ditgaottie RuIm, Part d Coluaa 1 it tht rult nuabtr 
classifisd by purpostt} Coluaa 2 it tht nuabtr in ordtr of eoaputtr 
iapltatntttioa^ oaly for progrtaitrt purpottt. 



7*7 (29) 

ii tha «vtr«tt r§ltv«iie« at this «owm<l(vitir««vg(r.lMt)) It 
ttMttr than 4 (t4) uA motm than 2 rteotdt «r« than « Mt««M It 
•iSMlIad (tt.t«ad(29)). 

8* Print control 

8.1 08) 

if tht rteord fonut of tht eurrtnt Ttn eo«Mnd it 1 
(rteord.forMtCr.lMt) thtn a Mttagt it tignallad (ta^tand(18)). 

8.2 (33) 

if tha ninbar of raeordt raquatttd in a TYPE eooMnd axcaadt th« 
thrathold for tha foraat raquatttd, according to tha tabla baloir, than 
a Mttaga ia tignallad (ta.tandOS)) and tha eoaaand it cancallad. 

POKMAI TBRBSHOLD 

(racord«fonut(r.latt+l) (ftit.ract(racord.fon»t(r.laat*l))) 

1 12 

2 4 
3.8 

4 8 

5 4 

6 12 

7 4 

8 4 

9. Utar raaponta intarval 

9.1 (34) 

if tha avaraga tiaa takan to antar coaBandt(tima.avg) it graatar 
than 30 tacondt than a aaataga it tignallad (ta.tand(34)). 

Tabla 2. Proeadural Oiagnottic Rulat, Part a. Column 1 it tha rula nuaibar 
elattifiad by purpotat} Coluaa 2 it tha nuabar in ordar of coaputar 
iBplaaantation, only for prograanart purpotat. 



3. A4«ptint Rttlf 

On« of tb« 9bj«etiv«t of the ZIOA coMinieadon with uMta it to «v.old 
fiving thMi a fMliag of h«rr««Mfit. Thi« could h«pp«n if th« M«««g« 
«wro r«p««e«d too oft«ii> wn if tho ttm fwlt i« of ton ropMttd. Tht Mjor 
function origiiuilly attignod to the Warning Control Prograa'iMt to dcfor 
aaaaagaa if « fault wora rapoatad aoon aftor a provioua inatanca of tha aa«a 
fault. A mora alaborato varaion of vaaaago dafaraant haa baan davalopad, 
callad rula adaptation . Rula adaptation providaa for automatic aaaaaga 
dafamant (i.a. poatpoacnttnt of aanding a aaaaaga whan a rula ia ra-violated 
too aoon>> for salting aoro atringant tha thraaholda uaod to docida whan 'to 
aand « aaaa«gt if tha rula ia violatad oftan> and to provida a aaana vharaby 
tha uaar can raquaat raliaf if tha program bacomaa too atringant. 

3.1 Natur* of Rula Adaptation 

For tha purpoaaa of adaptation^ rulaa ara catagorixad aa followa: 
1* Eaaantial eoaiand rapatition 

2. String langth 

3. Null aat ganaration 

4. Non uaad aata 

5. Exact conaand rapatition 

6. Dual rapatition (both aaaantial and axact) 

Only rulaa in thaaa catagoriaa ara adaptable. Tha ganaral idaa of adapta- 
tion ia that toaa rulaa > whan brokan^ may not ba conmantad upon by IIDA until 
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thty hm ba«a viol«t«d ••v«r«l tiata. . Thtay th« thrtthold it loetMitnead, to 
th«t ttvtrtl wof vlolttiont «r« ntcttttrj btfort taothtr attttg • will bf ttat 
.eonetrniiit thtC Itule. If thm thrttbold hM to bt iaertmtnttd too oftta, it 
it rtttt to a aort ttringtat Itvtl. If thit sort ttrinttnt Itvtl bteoatt too 
r«ttrieeiv« to tht uttr, h« etn rtquttt SLACK uliieb rtturat tht ehrtthold to 
itt original valua. 

Kara it ad axaapla of tha oparation of adaptation logiei - 

Tha utar antart 8 eontaeutiva SELECT eoMandt. Uta of a SELECT it not in 
any tanta a violation, but aig)tt in a row it, hanea a thrathold it tat at 8 
for langth of a ttring of thit elatt. 

Whan tha thrathold it raaehad, tha WCP it inforaad. Thit eautat a aattaga 
to ba tant to tha utar, a tiapla ttatanant of tha nuobar of eontaeutiva 
eoBundt that oeeurzad in tha ttring. 

Tha thrathold will now ba ineraaantad, by 3, to 11. If tha utar eontinuat 
to antar SELECT eomaiyit, no naw aattaga will ba tant until ha raaehat tha 
Uth eoaaand in tha ttring. At that point, a aattaga it tant and it it 
anhancad to thow that tha taaa fault hat oecurrad raeantly. Tha thrathold it 
again ineraaantad, by ^, to 14. - 

If tha utar eonf.inujat to antar SELECT eoapandt and raaehat eovumd nuabar 
14, tha WCP again tandti hia an anhanead aaaaaga. Now, baeauaa tha thrathold 
haa baan ineraaantad tw|Lea, tha ineraaant ia raaat, to tha aora ttringant 
valua of 2. Thua, tha aaxt thraahold valua it 16, two aora than pravioualy. 
Hhila 16 eontaeutiva SE^CTS aay appaar far fatehad, it doat happan. 

It aight wall ba that tha utar knowt ha ia violating an IIOA rula, but 
faala that thara ia juatifieation in baing to. If ha notieaa that IIDA is 

3(. 



ftttiag .ort .triattnt «Qd it«nt« thii ttopptd, tiittrf thtAxDA cp»md 
SLACK. Thif hat eh« tffaet of r«t«etiiig th« thrtihold tad its iaermnt to 
itt oritlMl vtlutf,* i.o., th« thwthoW «t «, th« IncrMiMt «t 3. 

Tho tpMlfie miabors utod horo, InitUl throthold of 8, incrwwat of 3, 
•tc, art all arbltrtpy, Thty vara baaad upon daaignara' aupariancaa, but 
•hould ba uUiaataly dataniinad by txpariiMntatioii. 

3.2 Aaaigioiant of Rulo« to Claaaaa. 

Rafar to tha Xiating of ruXaa in Tabla 2, and tha Uat of rula catagoriaa 
xn Saetion 3.1. Bulaa ara aaaignad to claaaaa aa followat 



Claia 


Rula noa. 


1. (Baaantial rapatition) 


1,2 


2. (String langth) 


3-8 


3. (Null aata) 


9-17 


4. (Nbn'-uaad aata) 


19; 20 (18 not adaptabla) 


5. (Exact conand rapatition) 


21-23 • 


6. (Dual rapatition) 


37,38 (24-36 not adaptabla) 




39-50 not adaptabla 



3.3 Evaluating Rula Adaptation 

Tha Warning Control Program waa craatad bacauia of tha parcaivad naad for 
flaxibility in adndniataring tha flow of aaaaagaa indicating rula violation. 
A fair triala convincad ua wa naadad avan oora flaxibility. For rulaa whoaa 



violations w«r« tioe eritioAl, «• vaatod eo g«t sort teringtnt gradually and to 
allow' th« uaar in affaet to ovarrula tha aaehiaa if ha withad. Thua, V9 
datignad tha variabla ioeramant for rula thratliold«» by nhieh wa would gat 
aora ttriagant a« aora violations oecurrad, but alto allow for utaroiiiitiatad 
alack. 

Now, wa SMat faca tha problM of tatting to datazBina tha appropriata 
laval of tatting for tha variout thratholdt and incrtmantt. Alto, it would ba 
datirabla to tatt to dataraina whathar thit forai of adaptiva bahavior on tha 
part of IIDA doat, indaad, induev tha bahcvioral changat in utart that wat 
• datirad* Our eonelution it that tLa nuiri>ar of tattt raquirad would ba to 
Itrga at to ba a,naar phytical iq>ottibility. Wa would hava to tun anough 
tattt that all arror typts occurrad c f tan ahpugh to provida a maaningful 
taapla, and than watch how variout tattingt affactad tha bahavior of tha 
arrant utara.^ Our attisMta it that thit would raquira thoutandt of taarchat 
to ba parforsiad througjh IZDA, with a fairly hodk>ganaoua group of utart. Tha 
cott of thit it tiaply bayond tha financial capability of tha projact* 
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